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Abstract 

The role of the Onsager reaction term (ORT) is not yet well understood in frustrated coupled 
oscillator systems, since the Thouless- Anderson-Palmer (TAP) and replica methods cannot be di- 
rectly applied to these non-equilibrium systems. In this paper, we consider two oscillator associative 
memory models, one with symmetric and one with asymmetric dilution of coupling. These two 
systems are ideal for evaluating the effect of the ORT, because, with the exception of the ORT, 
they have the same order parameter equations. We found that the two systems have identical 
macroscopic properties, except for the acceleration effect caused by the ORT. This acceleration 
effect does not exist in any equilibrium system. 

PACS numbers: 05.45.Xt, 87.18.Sn, 75.10.Nr 
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Coupled oscillators are of intrinsic interest in many branches of physics, chemistry and 
biology. Simple coupled-oscillator models involving uniform and global coupling have been 
investigated in some detail, and it has been found that they can be used to model many 
types of chemical reactions in solution ||TJ. However, in the modeling of more complicated 
phenomena, including those studied in the fields of neuronal systems, it is more necessary 
to consider coupled oscillators with frustrated couplings. 

The Onsager reaction term (ORT), which describes the effective self-interaction, is of 
great importance in obtaining a physical understanding of frustrated random systems, be- 
cause the presence of such an effective self-interaction is one of the characteristics that dis- 
tinguish frustrated and non-frustrated systems. In the case of equilibrium systems, we can 
rigorously evaluate the effect of the ORT in the Thouless-Anderson-Palmer (TAP) frame- 
work 0, and/or using the replica method Q. However, we cannot directly apply these 
systematic methods to non-equilibrium coupled-oscillator systems. We can define a formal 
Hamiltonian function on such systems. However, Perez et al. proved that the ground states 
of this Hamiltonian are not stationary states of the dynamics [|J. Therefore, it is impossi- 
ble to construct a theory based on a free energy for this class of systems. For this reason, 
in order to evaluate the macroscopic quantities in such systems that include an ORT, the 
self- consistent signal to noise analysis (SCSNA) which can be applied to systems without 
the Hamiltonian function has been used ||. The mathematical treatment of this method 
is similar to that of the cavity method 0. Some results obtained from the SCSNA consist 
with results from the replica method, but this method includes a few heuristic steps. While 
the SCSNA has indicated some interesting results, it is not sufficient to give a complete 
understanding of frustrated systems, and for this reason many theoretically fundamental 
questions remain in the study of such systems. In fact, even the existence of the type of 
self- interaction that can be described by the ORT is the subject of some debate || 0. 

In this paper, we discuss an effect of the ORT that exists only in frustrated globally 
coupled oscillator systems, and in particular cannot be found in equilibrium systems. In 
order to make this effect clear, it would be ideal for us to compare two frustrated systems 
that, with the exception of the different quantity of the ORT, have the same order parameter 
equations. In addition, it is desirable for these systems to have a clear correspondence with 
an equilibrium system, because the effects of the ORT are well understood in equilibrium 
systems. 
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In consideration of the above-mentioned points, a system of the form: 
dd>- N 

= u i + J v sin (^i ~~ 4>i + Pij + Po), (1) 

is ideal. In fact, such systems are well known as models of coupled oscillator systems 
||. Here, (pi is the phase of the i th oscillator (with a total of N) and Ui represents 
its quenched natural frequency. The natural frequencies are randomly distributed with a 
density represented by g{uo). We restrict g(uj) to a unimodal symmetric distribution for 
satisfying the condition that there exists one large cluster of synchronous oscillators. Also 
in Eq. ([3]), Jy and /3y denote the amplitude of coupling from unit j to unit i and its delay, 
respectively. In the present study, we have selected the following two generalized Hebb 
learning rules with random dilutions || to determine Jy and /3y-: 

^exp(i/%) = HE^i' ^ = exp ^)' ® 



1 with probability c 

5 (3) 

with probability 1 — c 



where 7 means the complex conjugate. {0f }i=i,- ,n,h=i,- ,p are the phase patterns to be stored 
in the present model and are assigned to random numbers with a uniform probability on 
the interval [0,27r). /i is an index of stored patterns and p is the total number of stored 
patterns. We define a parameter a (the loading rate) by a = p/N. When a ~ 0(1), the 
system has frustration. The quantity Qj is the dilution coefficient. Let Cjj = 1 if there is a 
non-zero coupling from unit j to unit i and c^- = otherwise. The number of fan-in (fan- 
out) is restricted to 0(N), i.e., c ~ 0(1). Here, we consider both the cases of symmetric 
dilution (i.e., cy = Cji) and asymmetric dilution (i.e., cy and are independent random 
variables) [TO . The quantity /5 in Eq. (0) represents a uniform bias. Due to the effect of 
this bias, the mutual interaction between a pair of oscillators is asymmetric, even if Jy = Jji 
and fiij = —/3ji. Such an unbalanced mutual interaction is the essence of the acceleration 
(deceleration) effect [Tl|, 0, 0. In the case of g{oj) = 5{oj — u> ), /3 = and cy = Cjj, this 



system can be mapped to a XY-spin system 0, [14], [15]. In this way, we can make a bridge 
between the frustrated coupled oscillator system and the equilibrium system. 

Let us consider steady states of the system in the limit t — > oo. Our theory is based 
on the condition that there exists one large cluster of oscillators synchronously locked at 



frequency Q and the number of this cluster scales as ~ 0(N). Under such a condition, Daido 
demonstrated through a scaling plot obtained from numerical simulations that variation of 
order parameter scales as 0(l/y/N) in ferromagnetic systems with one large synchronous 
cluster [|T(J. According to this result, we assume that the self-averaging property holds in 
our system and order parameters are constant in the limit iV — > oo. These assumptions in 
our theory were also introduced by Sakaguchi and Kuramoto (SK) flT7| ]. 

Redefining fa according to fa — > fa + Qt and substituting this into Eq. ([!]), we obtain 

~~ct + UJi ~ n = sin (^)^ ~~ cos(fa)hl, (4) 
where hi represents the so-called "local field" , which is described as 

hi = hf + ih\ = 

V -i V N 



N c 



For convenience, we write s« = exp(ifa). The order parameter m M , which is the overlap 
between the system state {si}i=i,...,jv and embedded pattern {£f }i=i,... ,n, is defined as 

v£<>." (6) 



N 

3=1 



The effect of the second term of Eq. (H), i.e., — Y7^Yl!j^i ^r^£f£j s i; i s equivalent to that 
of an effect of additive coupling noise || [H| [L8|. In the limit c — > 0, with cn/c kept finite, 
our system is reduced to a glass oscillator. Therefore, our theory proposed here can cover 
two types of frustrated systems, the oscillator associative memory and the glass oscillator. 

In general, the fields hf and h\ involve the ORT corresponding to the effective self- 
feedback ||. We must eliminate the reaction term from these fields. Here, we assume that 
the local field splits into a "pure" effective local field, hi — hf + ihf and the ORT, Tsj: 

hi = hi + Tsi. (7) 

Here we have neglected the complex conjugate term of the ORT leading to a higher-harmonic 
term of the response function [Tj|. This can be done in the present model because we employ 
generalized Hebb learning rules. Hence, by substituting Eq. (|7]) into Eq. (f|), we obtain the 
equation 

- ^ + Ui - = sm(fa)hf - cos(fa)hl (8) 
Q = fi-|r|sin(V>), V = Arg(r), (9) 



which does not contain the reaction term. The quantity Q here represents the effective 
frequency of synchronous oscillators. We can regard fl as the renormalized version of Q, of 
which the ORT has been pulled out, and therefore Q takes a different value from the observ- 
able Q in general. Thus, — Cl represents the contribution of the ORT to the acceleration 
(deceleration) effect. Cl is one of the order parameters of our theory. In the analysis that 
follows, hi and T are obtained in a self-consistent manner. Under the above assumption 
expressed by Eq. (0), by applying SK theory |17|] to Eq. (H), we obtain the average of Si 
over uo, ; : 




(10) 

Equation @ implies that Sj is a function of hi, uJi — Q and t, and to make this explicit 
we write 

Si = X(hi,uJi-VL,t). (11) 

Note that Sj is not a function of renormalized hi and Q but, rather, the bare hi and Q in 
appearing Eq. (|j). We can properly evaluate the ORT with this careful treatment. Here, we 
assume that microscopic memory effect can be neglected in the t — > oo limit. In this analysis, 
we focus on memory retrieval states in which the configuration has appreciable overlap with 
the condensed pattern £ x (m 1 ~ 0(1)) and has tiny overlap with the uncondensed patterns 
£ M for \i > 1 (m/ 4 ~ 0(1/\N)). Under this assumption, we estimate the contribution of the 
uncondensed patterns using the SCSNA||, and determine hi in a self-consistent manner. 
Finally, the equations relating the order parameters \m 1 \, U and Q are obtained using the 
self-consistent local field: 



m l \e-^ = ((X(x 1 ,x 2 ;Q))) , (12) 



XI, X2 



Ue -iPo = // Fl ( Xl ,x 2 ;n))) , (13) 



Xl,X2 



where ((• • • )) X2 is the Gaussian average over x\ and x 2 , ((■ ■ ■ )) X2 = f f Dx\Dx 2 
The quantity U corresponds to the susceptibility, which is the measure of the sensitivity to 



external fields. Since the present system possesses rotational symmetry with respect to the 
phase <pi, we can safely set the condensed pattern as ^ = 1 (i — 1, • • • , N). Now, h, X, F\ 
and Dx\Dx 2 can be expressed as follows: 



dx\dx 2 ( x\ + x 2 



D Xl Dx 2 = — ^ exp , (14) 



h = \m l \ + x\ + ix2, (16) 

X(x 1 ,x 2 ;Q) = (s) U) , (17) 

F 1 (x 1 ,x 2 ;f2) = ^, (18) 
oh 

where (s) w in Eqs. fll7|) and (jTSf) is written as Eq. (|i"0f) . 

In the case of the symmetric diluted system, T can be expressed as 

■ a all ail — c) , . 

1-U c K ' 

In the case of the asymmetric diluted system, on the other hand, we have 

re"** = ^L. (20) 

h and Q are the renormalized versions of h and Q respectively, of which the ORT has 
been pulled out, and thus h and Q are independent of the ORT. Therefore, the two models 
we consider have identical order parameter equations, ( |T2| ) and (|i~3D, written in the term of 
the renormalized quantities h and Q. According to Eq. the difference of the ORT in 
Eqs. (P^D and (|20| ) only leads a different value of the observable Q only when f] ^ 0. In 
this way we are able to clearly separate the effect of the ORT, and therefore, by observing 
the macroscopic parameter Q of these two systems, we can analyze the effect of the ORT 
qualitatively and quantitatively. 

The distribution of resultant frequencies to in the memory retrieval state, which is denoted 
p(uJ), becomes 

pip) = r5(p — Q) 



g 0+ (&-Sl)Jl + 



\h\ 2 



(zj-n) 5 



- / D Xl Dx 2 ^ S (21) 

v 1 + WW 

J Dx!Dx 2 \h\ J d<f>g{Q,+ \h\wy^jooa^>. (22) 



The (5-function in Eq. (|21|) indicates the cluster of oscillators synchronously locked at fre- 
quency Q. The value r is the ratio between the number of synchronous oscillators and the 
total number of oscillators N. The second term in Eq. ( |21~| ) represent a distribution of 
asynchronous oscillators. 

If p = and g(uS) is symmetric, our theory reduces to the previously proposed theory ||. 
In the case g(uS) = S(u), fto = and Qj = Cji, where the present model reduces to XY-spin 



systems (frustrated equilibrium systems), our theory coincides with the replica theory |9], [14 



and the SCSNA Hlg] . In addition, in the limit of a — > 0, where the present model reduces to 



uniform non-equilibrium systems, our theory reproduces the SK theory [|17 
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FIG. 1: The difference between symmetric and asymmetric dilution systems. Here N = 10,000, 
a = 0.2, /3o = 7r/20, and c = 0.5. (a) O as a function of a. (b) The distribution of resultant fre- 
quencies for the symmetric dilution system (a = 0.02). (c) The distribution of resultant frequencies 
for the asymmetric dilution system (a = 0.02). 



In the numerical simulations we now discuss, we chose the distribution of natural fre- 
quencies as g(u) = (27rcr 2 ) _1 / 2 exp(— u 2 /2a 2 ). Also, we set a = 0.2, (3 Q = n/20, and c = 0.5. 
Figure |TJ(a) displays Q as a function of a in the memory retrieval states, where the solid 
curves were obtained theoretically, and the data points with error bars represent results 
obtained by numerical simulation. As seen from Figure |l|(a), the oscillator's rotation for the 
symmetric diluted system is faster than that for the asymmetric diluted system. As previ- 
ously discussed, Cl in Figure |l](a), which represents the effective frequency of synchronous 
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FIG. 2: \m}\ as a function of a. The solid curves were obtained theoretically, and the data points 
were obtained from numerical simulations. Here N = 10,000, a = 0.2, /3q = ir/20, and c = 0.5. (a) 
Symmetric dilution system, (b) Asymmetric dilution system. 



oscillators, does not depend on the type of dilution, while the observed Q depends strongly 
on it. This dependence is due to the existence of the ORT T. In the case that the local field 
h does not contain the ORT |7]], the plots obtained from the numerical simulations for both 
models should fit the curve of Q. Therefore, the dependence of the observed Q on the type 
of dilution is strong evidence for the existence of the ORT in the present system. In this 
figure, we have shifted the numerical values of Q at a = (in the computer simulation) to 
their corresponding theoretical values at a = 0, in order to cancel fluctuations of the mean 
value of g(w) caused by the finite size effect. 

Figures 0(b) and (c) display the distributions of the resultant frequencies for the sym- 
metric dilution and asymmetric dilution systems, respectively. As these figures reveal, the 
theory (solid curve) is in good agreement with the simulation results (histogram). According 
to the results given in Figures [l|(b) and (c), the distributions of the resultant frequencies 
for the symmetric diluted system is identical to that for the asymmetric diluted system, 
except for a slight difference between those positions caused by the ORT. From this result 
we can conclude that the mean field h of the symmetric diluted system is identical to that 
of the asymmetric diluted system, since h reflects the distribution of resultant frequencies, 
as represented by Eq. Figures ||(a) and (b) display (m 1 ) as a function of a for sym- 

metric and asymmetric diluted systems, respectively. Here, the solid curves were obtained 
theoretically, and the data plots represent the results obtained from the numerical simula- 
tions. According to the results given in Figures ||j(a) and (b), the critical memory capacity of 
the asymmetric diluted systems obtained from numerical simulation is slightly smaller than 
that of the asymmetric diluted systems, because asymmetric dilutions break the detailed 
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balance, and then, asymmetric dilutions weaken a memory state. At this stage, there is no 
theory to rigorously treat a system with asymmetric interaction. Almost theoretical studies 
of asymmetric systems are based on the naive assumption that there exist steady states like 
symmetric systems [|TIJ . 

In conclusion, we have found that the symmetric and asymmetric diluted systems have 
the same macroscopic properties, with the exception of the the acceleration (deceleration) 
effect caused by the ORT. The quantity of the ORT depends on the type of dilution, and 
this dependence leads to a difference in the rotation speed of the oscillators for the two 
cases, as shown in Fig. |l](a). The acceleration (deceleration) effect caused by the ORT is a 
phenomenon peculiar to non-equilibrium systems, since this effect only exists when /3 ^ 0. 
There has been fundamental disagreement regarding the existence of the ORT in a typical 
system corresponding to our model with (3q = and a symmetric g(oo) |6], In this work we 
have reached the following conclusion in this regard. Even if (3 Q = and g{uj) is symmetric, 
the ORT exists in the bare local field given by Eq. @. In this case, the effect of the ORT 
is invisible, since it cancels out of Eq. (181). 
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